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20.  Abstract  (continued) 

the  expected  zero-crossing  rate  indexed  by  a  €  (-1,1),  is  always  de¬ 
creasing,  completely  determines  the  correlation  generating  function,  and 
is  equal  to  a  constant  if  and  only  if  the  process  is  a  pure  sinusoid  with 
probability  one.  When  the  process  is  a  sinusoid  plus  white  noise,  a 
sequence  {E[D  ],  j  =  1,2,...}  is  constructed  that  after  proper  normaliza- 
3 

tion  converges  to  the  frequency  of  the  sinusoid  regardless  of  the  signal 
to  noise  ratio.  A  real  data  example  is  given  in  tracking  the  vocal  sound 

of  a  megaptera  novaeangliae  whale. 
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Abstract 

Families  and  sequences  of  zero-crossing  counts  generated  by  parametric  time 
invariant  linear  filters  are  studied.  The  focus  is  on  the  family  of  zero-crossing 
counts  { Da }  generated  by  the  parametric  family  of  filters 

Ca  =  1  +  qB  4-  a2C2  +  •••  ,a  €  (—1,1) 

where  3  is  the  backward  shift.  In  the  case  of  a  stationary  Gaussian  pro¬ 
cess,  the  expected  zero-crossing  rate  indexed  by  a  6  (  —  1,1),  is  always  de¬ 
creasing,  completely  determines  the  correlation  generating  function,  and  is 
equal  to  a  constant  if  and  only  if  the  process  is  a  pure  sinusoid  with  prob¬ 
ability  one.  When  the  process  is  a  sinusoid  plus  white  noise,  a  sequence 
{E[DQj],j  —  1 , 2,  •  ♦  - }  is  constructed  that  after  proper  normalization  con¬ 
verges  to  the  frequency  of  the  sinusoid  regardless  of  the  signal  to  noise  ratio. 
A  real  data  example  is  given  in  tracking  the  vocal  sound  of  a  mcgaptera  no- 
vaeangliae  whale. 

Abbreviated  Title:  ’’Parametric  Crossings” 

Key  words  and  phrases:  Stationary  time  series,  spectrum,  Gaussian,  HOC- 
plot,  stochastic  ordering,  sinusoid. 

AMS  subject  classification:  Primary  62A/10,  secondary  62 A/07. 
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0.1  Introduction 

>  When  a  time  series  is  filtered,  the  effect  of  the  filter  can  be  described  by 
counting  the  resulting  number  of  zero-crossings.  By  extension,  we  can  apply 
to  a  time  series  a  family  of  filters  and  obtain  the  corresponding  family  of 
zero-crossing  counts.  The  resulting  family  of  counts  is  referred  to  as  higher 
order  crossings  or  HOC.  Thus,  HOC  are  zero-crossing  counts  observed  in  a 
time  series  and  in  its  filtered  versions.  The  main  application  of  HOC  is  in  the 
description  of  the  oscillation  observed  in  oscillatory  time  series.  Moreover, 
in  the  special  case  of  stationary  Gaussian  time  series  there  are  quite  a  few 
HOC  families  and  also  HOC  sequences  that  determine  the  spectrum  up  to  a 
constant. 

HOC  sequences  obtained  by  repeated  differencing  have  been  studied  in 
a  sequence  of  papers  beginning  with  Kedem  and  Slud  (1981,  1982)  and  re¬ 
viewed  in  Kedem(1986).  Such  HOC  are  called  simple.  In  this  paper  we  go 
a  step  further  by  introducing  the  notion  of  HOC  families  and  sequences  ob¬ 
tained  from  parametric  time  invariant  linear  filters.  The  emphasis  though  is 
on  the  useful  HOC  family  obtained  from  the  parametric  family  of  filters 

Ca{Z)t  =  Zt  -f  aZt^i  4-  q2Z(_2  +  •  •  •  (0.1) 

where  a  €  (  —  1,1).  It  is  convenient  to  refer  to  this  filter  as  the  a-filter.  It 
is  recognized  to  be  the  operation  of  exponential  smoothing.  In  the  Gaussian 
case,  the  family  of  expected  HOC  obtained  by  this  filter  in  an  a-neighborhood 
that  contains  the  origin  is  equivalent  to  the  correlation  generating  function. 
Furthermore,  the  family  of  expected  HOC  for  q  €  (-1, 1)  is  always  monotone, 
a  fact  that  standardizes  the  application  of  such  HOC  in  model  identification 
and  discrimination  between  lime  series.  Furthermore,  this  HOC  family  con¬ 
tains  HOC  sequences  indexed  by  a : ,  j  =  1,2,---,  that  are  useful  in  discrete 
spectrum  estimation  in  the  presence  of  noise.  This  is  demonstrated  in  the 
case  of  a  single  frequency  when  the  noise  is  white  Gaussian  noise. 

In  the  sequel,  by  "stationary”  we  mean  both  strict  and  wide  sense  simul¬ 
taneously  unless  we  specify  an  appropriate  adjective. 

r  “The  paper  is  organized  as  follows.  In  section  2  we  define  and  also  give 
examples  of  HOC  from  parametric  families  of  linear  filters.  We  outline  there 
our  motivation  for  studying  HOC  in  connection  with  oscillatory  time  series. 
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In  section  3  we  construct  an  adaptive  HOC  sequence  from  (0.1)  that  converges 
to  a  frequency  in  the  presence  of  noise.  As  a  matter  of  fact,  the  main  result 
there,  Corollary  1,  has  prompted  our  interest  in  pursuing  HOC  in  connection 
with  parametric  linear  operations.  In  section  4  we  obtain  more  results  about 
the  HOC  family  from  (0.1).  Our  main  result  there  is  the  connection  between 
the  zero-crossing  rate,  as  a  function  of  the  parameter,  and  the  correlation 
generating  function  under  the  Gaussian  assumption.  In  section  5  we  analyze 
a  vocal  sound  time  series  of  a  megaptera  novaeangliae  (humpback)  whale.  f: 

f 

0.2  Parametric  Families  of  Zero-Crossing  Counts 

The  mathematical  formulation  of  the  idea  behind  HOC  can  be  outlined  in 
four  steps  as  follows. 

1.  We  start  with  a  time  series  observed  in  discrete  time 

{ Zt },  <  =  0,±1,±2,-.- 

2.  Let 

{£#(•)>  *€6} 

be  a  parametric  family  of  filters  indexed  by  6.  The  parameter  space  0  may 
be  an  interval  or  a  countable  set  in  one  or  more  dimensions.  That  is,  6  may 
be  a  vector. 

3.  Fix  S  G  0  and  let  D$  be  the  number  of  zero-crossings  in  discrete  time 
(defined  precisely  below)  observed  in  the  time  series 

Ce(Z)lXe(Z)2,---Xe(Z)N 

of  length  N  from  the  filtered  process 

{Ce(Z)t},  t  =  0,  ±1,  ±2,  •  •  • 

4.  The  corresponding  HOC  family  is  given  by 

{T>*,0e0} 

We  note  that  this  formulation  is  somewhat  more  general  in  scope  than 
the  one  given  previously  in  Kedem(198f>)  and  allows  for  various  extensions. 
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The  emphasis  in  the  present  paper  is  on  putting  together  zero-crossing  counts 
and  parametric  linear  time  invariant  filters  to  produce  useful  HOC  sequences 
and  families.  In  general,  HOC  sequences  and  families  contain  a  great  deal 
of  spectral  information,  and  serve  as  potent  features  in  discrimination  and 
classification.  In  a  more  abstract  sense,  HOC  families  constitute  a  combina¬ 
torial  domain  that  in  many  respects  is  equivalent  to  the  spectral  domain  and 
yet  this  domain  has  many  interesting  distinctive  features  of  its  own. 

Before  proceeding  with  some  examples,  we  must  define  precisely  what 
is  meant  by  zero-crossing  counts  in  discrete  time.  For  this  purpose  it  is 
convenient  to  introduce  the  family  of  binary  time  series: 


Xt(0)  = 


1,  if  Cg(Z)t  >  0 
0,  if  Ce(Z)t  <  0 


t  —  0,  ±1,  ±2,  •  •  •  The  number  of  zero-crossings  in  Cg(Z)  i,  £e(Z)2,  •  •  • ,  Cg(Z)^ 
is  defined  as  the  number  of  symbol  changes  in  X\{9),  •  •  • ,  XnW  : 


1=2 

When,  for  some  6,  Cg(-)  corresponds  to  the  identity  filter  then  Dg  is  the 
number  of  zero-crossings  in  the  original  unfiltered  series  Zj,  •  •  • ,  Z/v.  We  can 
see  that  Dg  depends  on  N  and  that  this  dependence  is  more  apparent  in  the 
zero-crossing  rate  defined  by 

MO) ,  ^ 


But,  clearly,  the  expected  rate 


1(0)  = 


E\Dg ] 
N  -  1 


need  not  depend  on  N  as  is  the  case  for  a  strictly  stationary  process.  In 
studying  HOC  families,  at  times  we  let  6  change  while  holding  N  fixed  and 
at  other  times  6  is  fixed  but  N  changes. 


0.2.1  Examples  of  Parametric  HOC  Families 

(1).  HOC  from  differences. 

Let  V  be  the  difference  operator  defined  by 

V  ^i  =  Zj  —  Zt_i 
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and  define 

Ce  =  V9"\0€  {1,2,3, 

with  C\  =  V°  being  the  identity  filter.  The  corresponding  HOC  sequence 


D i,  Diy  D 


3,  •  •  • 


gives  the  simple  HOC.  When  Zt  is  a  zero-mean  stationary  Gaussian  process 
with  spectral  distribution  function  F(lj)  then,  by  virtue  of  the  well  known 
arcsine-law  (e.g.  David  (1953)),  the  simple  HOC  obtained  by  repeated  dif¬ 
ferencing  admit  the  spectral  representation  (Kedem(198f>)) 


px{6)  =  cos[tt7(0)] 


ffr  cos(oj)(sin(io/2))^e~^dF(u>) 

2))2(*-1)dF(u;) 


(0.2) 


where  p\(6)  is  the  first-order  correlation  in  the  filtered  process  { Cg(Z)t }.  The 
sequence  y(0)  is  bounded  and  monotone  increasing  in  0  so  that 


71-7(0)  — ♦  ,  0  — ►  00 


(0.3) 


where  u>"  is  the  highest  frequency  in  the  spectral  support.  We  shall  provide 
a  proof  of  this  fact  later.  When  7(1)  =  7(2)  then  Zt  is  a  pure  sinusoid  and 
7T7(0)  is  a  constant  equal  to  the  frequency  of  the  sinusoid  (Kedem(1984)). 

It  should  be  noted  that  in  the  Gaussian  case  the  left  hand  side  of  (0.2), 
Pi(0)  =  cos[K~f{6)],  holds  in  general  for  any  filtered  process  {Ce(Z)t}.  This 
” cosine-formula”  is  known  to  hold  also  for  processes  whose  finite  dimensional 
distributions  are  spherically  symmetric  of  which  the  Gaussian  distribution  is 
a  special  case  (He  and  Kedem  (1988)).  The  formula  is  of  fundamental  im¬ 
portance  in  the  study  of  HOC,  and  finding  a  similar  formula  for  stationary 
processes  whose  finite  dimensional  distributions  arc  not  spherically  symmet¬ 
ric  is  a  challenging  and  intriguing  problem. 


(2).  HOC  from  repeated  summation. 

Let  B  be  the  shift  operator  defined  by 

BZt  =  Z,_, 

and  define 

Ce~(  1 +£)*-',  *€{1,2,3,..-} 
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The  corresponding  HOC  are  called  HOC  from  repeated  summation  and  the 
sequence  {D0}  is  monotone  decreasing  in  6,  and  in  the  Gaussian  case 

iri{6)  — ♦  u>.,  0  — >  00  (0.4) 


where  u>.  is  the  lowest  frequency  in  the  spectral  support  of  F(u>).  This  can 
be  shown  using  the  spectral  representation 


cos\k^{0)] 


flr  cos(u>)(l  -f  cos(u))(fi  ^dF(ic) 
flAl  +  cos{u)Ye~^dF(uj) 


(0.5) 


From  (0.3)  and  (0.4)  we  can  determine  all  the  frequencies  and  their  number 
in  a  stationary  Gaussian  process  with  a  purely  discrete  spectrum.  First,  from 
(0.4),  we  obtain  the  lowest  frequency  by  repeated  summation.  Then,  from 
(0.3),  we  obtain  the  highest  frequency  and  filter  it  out,  the  second  highest 
and  filter  it  out,  and  so  on  until  there  is  a  single  frequency  left  in  which  case 
it  must  be  the  lowest  one  that  we  already  know,  and  we  stop  (Kedem(1986)). 


(3).  HOC  from  exponential  smoothing. 

We  can  rewrite  (0.1)  more  compactly  as  follows.  Let 


Zt(o)  =  Ca{Z)t 


Then  (0.1)  becomes 

Zt{a)  —  aZt-i(ct)  +  Zt,  a  £  (  —  1, 1)  (0.6) 

The  corresponding  HOC  family  {A,},  a  €  (  —  1,1)  is  the  main  subject  of  the 
present  paper.  When  {Zt }  is  a  zero  mean  stationary  Gaussian  process  then, 
as  we  shall  see,  7(0)  is  monotone  decreasing,  and  we  obtain  the  spectral 
representation 


COs[7T7(o)]  = 


f-r  COs(u>)\H(u}\  o)|2dF(u,’) 
fir  |H(w; a)|2<iF(u;) 


(0.7) 


where 


a)|2  = 


1 


1  —  2acos(w)  +  a2 


,  a  €  (-1,1),  G  [0,ir 
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(0.8) 


In  that  case  we  show  that  7(a)  is  equivalent  to  the  normalized  spectrum.  I11 
general,  however,  this  equivalence  need  not  hold  and  7(0)  may  contain  some 
extra  useful  information.  This  point  is  brought  up  again  later  in  a  real  data 
example  where  we  apply  both  the  spectral  density  and  ')s(q)  in  the  analysis 
of  vocal  sound  of  a  humpback  whale. 

(4).  HOC  from  autoregressive  moving  averages  operations. 

A  more  general  family  of  parametric  filters,  and  one  that  contains  the  previ¬ 
ous  examples  as  special  cases,  is  defined  by  the  autoregressive- moving  average 
operation 


Yt  —  cq  }  t_i  —  •  •  ■  —  dpYt-p  —  Zi  —  b\  Zf_j  —  ■  •  •  bqZt-q 


(0.9) 


where  now 


Dg  —  Da ,  >0j 


Not  much  is  known  at  present  about  the  HOC  { Dg }  of  this  general  case, 
except  for  some  results  of  a  general  nature  given  below. 


0.2.2  HOC-plots  from  a  process  with  adjoined  random 
variables. 

To  illustrate  the  ability  of  HOC  to  summarize  and  describe  the  oscillation  in 
time  series,  it  is  instructive  to  consider  some  special  cases  while  exploiting 
the  strong  graphical  appeal  inherent  in  HOC.  For  this  purpose  we  consider 
a  zero-mean  non-Gaussian  stationary  process  Jefined  as  follows.  Let 


7j,  X3,  •  •  ■ 

be  a  sequence  of  IID  random  variables  from  a  geometric  distribution  with 
parameter  p ,  and  let 

uuu2,u3,-.. 

be  a  sequence  of  independent  standard  normal  random  variables.  Consider 
the  stationary  process  {Ztj  defined  by: 

=  f/,,  1  <  t  <  T, 

=  (/a,  7\  <  t  <  T'2 


Zt 

Zt 


f> 


^3>  ^2  <  t  <  T3 


Zt  = 


The  process  { Zt }  is  called  a  process  with  adjoined  random  variables.  Its 
behavior  is  determined  by  the  parameter  p.  Figure  1  shows  realizations  of  the 
process  corresponding  to  p  =  0.10,0.25,0.50,0.75.  The  corresponding  nor¬ 
malized  HOC  plots  of  7n(-)  from  simple  HOC  and  HOC  obtained  from  the 
a-fiiter  (0.1)  are  given  in  Figure  2.  The  figures  also  contain  the  normalized 
HOC  7a’(  )  from  white  Gaussian  ,ioise  for  the  sake  of  comparison.  We  see 
that  simple  HOC  increase  while  the  HOC  from  the  o-filter  decrease  as  they 
should.  The  reason  for  this  displayed  monotonicity  is  that  the  gain  functions 
of  these  parametric  linear  filters  are  themselves  monotone.  See  Theorem  2 
below. 


0.2.3  Why  HOC  ? 


There  is  a  close  association  between  the  autocorrelation  function  pk  and 
HOC.  As  remarked  earlier,  in  the  Gaussian  case,  there  are  HOC  families 
that  are  equivalent  to  the  autocorrelation.  For  example,  knowledge  of  the 
sequence  of  expected  HOC  from  differencing  E[Dj ]  is  equivalent  to  knowing 
Pk  in  the  sense  that  each  sequence  completely  determines  the  other.  Thus  it 
seems  tempting  to  say,  at  least  when  facing  that  equivalence,  that  the  close 
association  between  HOC  and  pk  eliminates  the  need  for  HOC.  The  truth, 
however,  is  that  HOC  sequences  and  families  have  certain  inherent  advan 
tages  over  the  autocorrelation  that  warrant  their  study.  Here  are  some. 

(1).  Resistance  to  outliers. 

In  the  presence  of  extreme  values,  the  sample  auotocorrelation  may  resemble 
the  auotocorrelation  of  white  noise.  This  can  easily  be  seen  when  a  time 
series  contains  a  single  large  outlier.  In  this  case  the  sample  auotocorrelation 
tends  to  zero.  The  zero-crossing  count  from  the  unfiltered  original  data  how¬ 
ever  is  left  intact.  The  same  also  holds  after  decimation  when  only  subseries 
(e.g.  Zi,Z3,  Z5,  ■  •  •)  are  considered. 


(2).  Relation  to  the  spectral  support. 
The  normalized  quantity 


7Tj(0) 


n  E\De] 
N  -  1 


takes  values  in  the  interval  [0,7r],  It  is  therefore  easy  to  relate  it  directly 
to  specific  frequency  bands  and  discrete  frequencies  in  the  spectral  support. 
When  6  corresponds  to  a  highpass  (Iowpass)  filter,  ^7 (0)  moves  to  the  right 
(left)  so  that  by  varying  9  intelligently  we  can  force  or  rpush”  n”f(0)  to  land 
on  any  desired  frequency.  Important  special  cases  of  this  fact  were  already 
seen  earlier  in  (0.3),  (0.4),  and  are  seen  again  later  in  Theorem  1  and  its 
corollary. 

It  is  interesting  to  observe  that  the  point  can  be  moved  along  the 

spectra;  support  by  adding  sinusoidal  components  at  will.  High  (low)  fre¬ 
quency  components  with  sufficient  power  can  cause  to  move  to  the 

right  (left)  as  is  the  case  with  highpass  (Iowpass)  filtering. 


(3).  Exceeding  autocorrelation  information. 
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For  non-Gaussian  processes  {Dg,6  6  0}  may  contain  more  information  than 
the  autocorrelation.  As  alluded  to  earlier,  a  clear  indication  of  this  fact  is 
given  in  our  data  example  in  section  5.  In  general,  {D$,0  €  0}  may  be  inter¬ 
preted  as  yet  another  type  of  "spectrum”  that  relates  directly  to  oscillation. 
In  this  respect  kD$/(N  —  1),  where  6  corresponds  to  the  identity  operation, 
may  be  viewed  as  the  basic  "period”  of  the  process. 

(4) .  Graphical  information. 

HOC  sequences  and  families  convey  a  great  deal  of  graphical  information  that 
can  be  related  to  the  general  appearance  of  time  series.  For  example,  simple 
HOC  from  differencing  D},  D2,  D3,  •  •  •,  pertain  to  zero- crossings,  peaks  and 
troughs,  inflection  points,  •  •  •,  respectively.  In  this  connection  it  is  worth 
noting  that  if  Dj  ~  for  low  order  j,  then  there  is  good  chance  the  data 
contains  a  marked  sinusoidal  component. 

(5) .  Lack  of  moments. 

A  strictly  stationary  process  may  not  possess  moments  of  any  order  so  that 
the  usual  definition  of  autocorrelation  and  spectrum  does  not  apply.  HOC, 
however,  adapt  easily  to  this  situation  because 

=  aTTT 

possesses  all  moments.  Thus  HOC  can  provide  a  first  hand  feel  of  the  oscil¬ 
lation  regardless  of  the  existence  of  moments. 

(6) .  Lack  of  stationarity. 

A  non  stationary  process  may  still  generate  very  regular  oscillation  despite 
of  its  overall  time  dependent  behavior.  When  this  is  the  case,  the  zero¬ 
crossing  rate  is  a  quantity  to  be  reckoned  with.  An  example  is  furnished  by 
a  nonstationary  AR(2)  with  two  unit  roots  ezp(±().  The  process  is  both 
explosive  and  also  very  oscillatory,  but  its  oscillation  is  essentially  the  same 
as  that  of  a  pure  sinusoid.  It  has  been  shown  in  He  and  Kedem  (19896)  that 

l.i.m.tf — =  0  ^  C  <  * 

where  D\  is  the  number  of  zero-crossings  in  the  observed  unfiltered  time  se¬ 
ries.  Note  that  this  is  an  example  where  0  —  1  is  fixed  while  N  changes. 
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0.3  Detection  of  a  single  frequency  in  noise. 

The  ideas  expressed  above  can  be  illustrated  very  well  by  considering  the 
problem  of  detecting  a  single  frequency  in  the  presence  of  white  Gaussian 
noise  using  the  a-filter.  We  shall  construct  an  expected  HOC  sequence  that, 
under  the  Gaussian  assumption,  converges  to  the  frequency  regardless  of  the 
magnitude  of  the  noise  variance.  For  this  purpose  we  generalize  a  result  of 
He  and  Kedem  (1989a). 

First  we  need 


Lemma  1.  Let  \H(w,a)\2  be  given  by  (0.8),  and  let  p  be  a  positive  integer. 
For 

0  <  U>\  <  <  •  •  •  <  u>p  <  7T 

and  for  positive  constatnts 

2  2  2 

define  the  convex  combination 

Ej=i  ^2|#(^;a)|2cos(^) 

Then  £(a)  is  monotone  increasing  for  a  €  (-1,1). 


(0.10) 


Proof:  For  Qi,a2  €  (  —  1, 1)  suppose  qj  <  o2,  and  define 

akl  =  \H(u>i;ai)l*\H(u>l;a2)l7 

for  k,  /,  =  1  ,*••,/>.  To  show  that  ( ;(o2 )  -  £(oj)  >  0  it  is  sufficient  to  show 
that  for  any  choice  of  k  <  /,  a;*  —  a*;  >  0  where  i a*  <  u';,  or  equivalently, 
cos(a>/t)  >  cos(ui).  The  numerator  of  a/jt  -  is  equal  to 

2(cos(u.’*;)  -  cos(tj/))(l  —  Oia2)(a2  —  Qi)  >  0 

The  corresponding  denominator  is  always  positive,  and  the  lemma  is  proved. 

□ 


Consider  now  the  mixed  spectrum  stationary  Gaussian  process 

p 

Zt  =  ^{AjCos{ujt)  +  +  f,  (0.11) 

j=i 


12 


where  the  X’s  and  B's  are  all  independent,  Aj,B:  ~  TV(0,  <72),  and  {et}  is 
white  Gaussian  noise  with  mean  0  and  variance  <72,  independent  of  the  A's 
and  B's.  As  before  0  <  ui\  <  u>2  <  •  •  •  <  u>p  <  ir.  We  have 


Theorem  1.  Consider  the  harmonic  process  (0.11)  and  choose  an  arbitrary 
constant  q0  G  (  —  1, 1).  Define  the  sequence 


ai*<  = «»(  N  _  / ) 


Then  as  j  — ►  oo 
where  a’  is  a  fixed  point  solution  of  the  equation 


— »  a 


(0.12) 


tfO  =  a* 


(0.13) 


and 


o>i  < 


*£(£>».] 

TV  -  1 


<  u> 


p 


Proof:  Let  |/f(w;a)|2  be  given  by  (0.8).  The  Gaussian  assumption  implies 
that 


*E[Da\  _  ft  cos(u,))H(u,;a)fdF(u) 

C°S 1  N-l  ’  Jq  )//(u;;  a)|2dF(u;) 

where  .T(w)  is  the  spectral  distribution  function  of  {Zt}.  Define 

Then  from  (12),  (14),  (15)  it  follows  that  for  fc  =  0, 1, 2,  •  •  • 

((c»fc)  +  W^ajJafc 

afc+1  ~  1  +  W{ak) 

In  deriving  (0.16)  it  helps  to  observe  that 

f  |//(u.;o)|,^  = 

Jo 


(0.14) 


(0.15) 


(0.16) 
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7T 

1  —  a2 


and 


r  cos(u))\H {u\  a)^ dio  =  - — — — -a 

0  1  —  Of* 

Observe  that  an+i  is  a  convex  combination  and  that  it  must  fall  between  a* 
and  £( a*. ).  Suppose  a0  <  £(a0).  Then 

c*o  <  <  £(<*o) 

But  £(a)  is  monotone  increasing  so  that 


c*o  <  <  £(<>i) 


Similarly,  whenever  ay  <  ay+i  <  £(aJ+1)  then 


Ofj+i  <  ai+2  < 

and  so  {ay}  is  a  monotone  sequence.  But  for  a  6  (  —  1, 1) 

cos(cjp)  <  ((a)  <  cos(u> i) 

and  therefore  {ay}  is  also  bounded.  It  follows  that  {ay}  converges  to  a.,  say. 
Then  from  (0.16) 


£(a.)  -f  W/(a.)a. 
1  +  VT(a.) 


(0.17) 


or  that 

a.  =  {(a.) 

Conversely,  suppose  ao  >  4(Qo)-  Then  by  a  similar  argument  there  exists  an 
a,,  such  that  ay  — ♦  a,,  and 


a..  =  £(a..) 


It  follows  that  as  j  — »  oo,  ay  — ♦  q*,  where  a’  =  £(a*)  for  some 


or  equivalently 


a*  6  (cos(u}p),(cos(u>i)) 


7T  E[D0j) 
N  -  1 


jt£[£>0.] 
N  -  1 


£  (whwp) 
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□ 


For  the  case  p  =  1  we  obtain  the  result  of  He  and  Kedcm  (1989a). 

Corollary  L  Suppose  p  =  1.  Then  regardless  of  the  signal  to  noise  ratio, 

— »  u>i,  j  — ►  oo  (0.18) 


*E{D0}\ 


Proof:  Here  uip  =  u>x.  □ 


Table  1  shows  some  examples  of  the  convergence  in  (0.18)  using  simulated 
data  of  a  single  sinusoid  plus  noise.  In  applications  7(a)  is  replaced  by  7^(0), 
a  consistent  estimate  under  the  model  at  hand.  Evidently,  for  reasonable 
signal  to  noise  ratio  the  algorithm  converges  rather  fast.  Observe  that  no 
Fourier  type  analysis  has  been  used,  and  that  u>x  need  not  be  a  Fourier 
frequency  of  the  form  2i rk/N. 


Table  1.  Convergence  of  towards  u!  =  0.8  with  N 
where  the  signal  to  noise  ratio  (SNR)  is  given  in  dB. 


ldB  OdB  -1.94dB  -6.02dB  -10dB 


Qo  =  ~-l 

Qo  —  .9 

Qo  =  .2 

Qo  =  .5 

Qo  =  •  i 

0.8848 

0.5194 

0.9127 

0.9291 

1.3381 

0.8006 

0.5904 

0.8222 

0.8713 

1.2294 

0.7987 

0.6563 

0.8015 

0.8411 

1.1251 

0.7987 

0.7142 

0.7965 

0.8191 

1.0371 

0.7987 

0.7600 

0.7952 

0.8053 

0.9617 

0.7987 

0.7864 

0.7952 

0.8015 

0.9077 

0.7987 

0.8002 

0.7952 

0.7990 

0.8756 

0.7987 

0.8065 

0.7952 

0.7984 

0.8511 

0.7987 

0.8065 

0.7952 

0.7977 

0.8449 

0.7987 

0.8065 

0.7952 

0.7971 

0.8436 

0.7987 

0.8065 

0.7952 

0.7971 

0.8423 

0.7987 

0.8065 

0.7952 

0.7971 

0.8405 

0.7987 

0.8065 

0.7952 

0.7971 

0.8392 

0.7987 

0.8065 

0.7952 

0.7971 

0.8379 

0.7987 

0.8065 

0.7952 

0.7971 

0.8361 

0.7987 

0.8065 

0.7952 

0.7971 

0.8335 

0.7987 

0.8065 

0.7952 

0.7971 

0.8323 

0.7987 

0.8065 

0.7952 

0.7971 

0.8310 

0.7987 

0.8065 

0.7952 

0.7971 

0.8298 

0.7987 

0.8065 

0.7952 

0.7971 

0.8310 

0.7987 

0.8065 

0.7952 

0.7971 

0.8298 

Note:  SNR  =  20/og10,--pna-'  dB 

- —  a.d.noiac 


=  iOOOO 
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0.4  The  HOC  from  the  o-filter 

In  the  previous  section  we  were  concerned  with  an  important  special  case 
of  spectrum  analysis.  It  was  shown  that  the  HOC  family  from  the  a-fiiter 
contains  a  sequence  that  (after  proper  normalization)  converges  to  a  discrete 
frequency  amidst  white  noise.  This  fact  emboldens  us  to  believe  that  the 
HOC  from  the  o-family  contains  considerably  more  spectral  information. 
That  this  is  indeed  the  case  is  shown  in  the  present  section.  It  is  shown  that 
in  the  Gaussian  case  the  HOC  family  from  the  a-filter  completely  determines 
the  correlation  generating  function  of  the  original  unfiltered  process. 

0.4.1  Preliminary  results  on  linear  filtering 

Let  {Zt},t  —  0,±1,±2-  -,  be  a  zero  mean  stationary  process  with  autoco¬ 
variance  Rk,  autocorrelation  pk,  and  generalized  spectra]  density  f{oj)  that 
contains  ^-functions  correspinding  to  the  points  of  jump  in  the  spectral  dis¬ 
tribution  function.  Let  Ca  be  a  parametric  family  of  linear  time  invariant 
filters  with  impulse  response  {/in(a)}? and  transfer  function  7/(u>;a)  where 

=  TT(hn(a))  =  ^Texp(-inuj)kn(a)  (0.19) 

n 

Wherever  applicable,  we  always  make  the  regularity  assumptions  that  /i„(q) 
is  absolutely  summable  in  n  and  that 

f  |//(u.’; a)|2/(u?)du>  <  oo  (0.20) 

J  —  i r 

We  define  the  filtered  process  indexed  by  a  as  before 

Zt(a)  =  C0(Z)t  =  (0.21) 

n 

In  other  words 

Zt{a)  =  ht{a)  ®  Zt  (0.22) 

where  <2>  denotes  convolution.  Denote  the  autocovariance  and  autocorrelation 
of  {Z((q)}  by  /4(a),  and  /»jt(a),  respectively. 

The  next  result  shows  how  to  compute  the  autocorrelation  of  {Zt  («)} 
from  pk  .  The  result  is  well  known  but  it  is  brought  here  for  completeness. 


17 


Lemma  2.  Let  Ja  be  a  time  invariant  linear  filter,  indexed  by  a,  whose  im¬ 
pulse  response  {^(a)}^  is  given  by  the  convolution 

gn(a)  =  hn(a)  ®  /i_n(a) 


Then 


and 


/>n(o) 


<7a(p)n 

Jct{p)  0 


Ja{p)u  =  9n{a)  +  £(<7n  +  l(«)  +  9n-t(«))pt, 


(  =  1 


n  =  0,  ±1,  ±2,  ■ 


(0.23) 


(0.24) 

(0.25) 


Proof:  Observe  that 

fT(Ja(R)n)  =  ^FT(gn(a)®Rn)  =  rT(hn(a)i8fk.n(a)®Rn)  =  //(w;a)77R 

By  taking  the  inverse  Fourier  transform  we  obtain 

Ja{R)n  =  f  exp(znu;)j//(u;;  a)]7  f(u)du>  =  Rn(a ) 

J  —  7T 


Therefore 


n 


(  )  -  _  J°(R)n  _  RoJa{p)n 

Pn[0)  “  Jlo(a)  “  J0(«)o  “  «oJa(^)o 


An  important  consequence  of  the  application  of  a  linear  filter  is  that  the 
autocorrelation  is  altered.  In  particular  if  in  addition  the  gain  function  is 
monotone  increasing  (decreasing)  the  process  becomes  more  (less)  oscilla¬ 
tory  and  the  correlation  between  neighboring  points  decreases  (increases). 
Intuitively  this  is  what  one  expects  of  highpass  (lowpass)  filtering,  but  in 
the  case  of  monotone  gains  this  intuition  becomes  factual  as  shown  in  the 
following  theorem. 


)2jt/(u>) 
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Theorem  2.  Suppose  the  squared  gain  function  \H(uj)\2  is  monotone  increas¬ 
ing  in  [C,tt].  Denote  by  pi(H )  the  first-order  correlation  in  the  filtered  pro¬ 
cess.  Then 


P\  >  P\{H) 


When  the  gain  is  monotone  decreasing  the  inequality  is  reversed. 


(0.26) 


Proof:  The  proof  makes  use  of  properties  of  stochastic  ordering.  Define  for 
A  €  [0, 7r]  the  probability  distribution  functions, 


F(\)  = 


Sc  f  M<k 

/o'  f(u)dw 


and 


W)  = 


fo  \H(u>)\2f(u)du 


fo  \H(u>)\*f(u>)du> 
Suppose  \H{u)\2  is  monotone  increasing.  Then 


F(\)  -  F„( A) 

So  \H(us)\2f(u)du,fXf(u)du  -  /;  f(u)duj0x  I 
Jo'  J»<Wo' \H{u>)\*f{u;)du 

/;  \H(u)\2 f{u)dio  fo  f(u)du  -  /;  f(u)du,Jx  \H(u)\7f{u)duj 

ff  f(u)duJf\H(u;)\2f(us)du 

>  j//(A)P  /;  /(ui)dui  /0A  f(u>)du>  -  [//( A)j2  ff  /Mju;  fx  /(cv)dus 
f0*f(u)duti\H(u)\2f(u>)du 

=  0 


and  therefore  for  all  A  6  [0, 7r] 

F( A)  >  F„(A)  (0.27) 

Thus,  if  A',  Y  are  two  random  variables  such  that 

X  ~  />,  Y  ~  F 

then  A  is  stochastically  larger  than  Y  and  this  means  that 

£[»(.V)]  >  E[g(Y)  1 
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for  every  increasing  function  g  defined  on  [0, 7r]  (Marshall  and  Olkin  (197  9)). 
In  particular,  for  the  increasing  function 

g(u)  =  1  —  cos(u>),  0  <  u>  <  x 


we  obtain, 

1  —  [  cos(u)dFn(u)  >  1  —  /  cos(uj)dF{u) 

Jo  Jo 

But  this  means  that  P\{H)  <  p\. 

In  the  same  way  we  can  also  prove  the  reversed  inequality  when  the  gain 
is  monotone  decreasing.  □ 

Corollary  2.  Suppose  {Zt}  is  Gaussian.  Then  the  simple  expected  HOC 
{E[Dj]}  from  repeated  differencing  are  monotone  increasing, 

E[Dj]  <  E[D}+il  j  =  1,2,3,- ...  (0.28) 


and 


*E\D,\  _ 4  . 

N  -  1 


where  u>*  <  7r  is  the  highest  frequency  in  the  spectral  support. 


(0.29) 


Proof:  (0.28)  follows  because  of  (0.2)  and  the  fact  that  the  squared  gain 
of  the  difference  operator  is  equal  to 


2(1  —  cos(u)) 


and  is  seen  to  be  increasing  in  [0,*].  Thus  the  simple  expected  HOC  arc- 
monotone  increasing.  To  prove  (0.29)  observe  that  the  normalized  expected 
HOC  are  also  bounded: 


0  < 


lMEA<r 

N -l  ~  ' 


and  therefore  must  converge.  Also  note  that  the  spectral  measure  of  {( VJZ)( } , 
denoted  by  t/;(-),  is  given  by 


Vj{du)  = 


sin7j  (u>/2)dF(uj) 
J%sin*>(\/2)dF{\) 
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where  F  is  the  spectral  distribution  function  of  (Zt).  It  follows  that  (0.2) 
can  be  written  more  compactly  as 


,*■  £(£>+iK  r  ,  \  u  s 

cos(-^—-)  =  J  cos(u)i/j(tL}) 


But  from  Kedem  and  Slud  (1982)  v}(-)  converges  weakly, 


1  ,  1  , 


oo 


where  6U  is  the  unit  point  mass  at  u.  Therefore  as  j  — ♦  oo 

nE[D)+l] 

cos(~ — *  cos^  ) 

and  use  the  fact  that  cos(x),  x  £  [0,  tt]  is  monotone.  □ 


Remark  1:  A  direct  combinatorial  way  to  obtain  (0.28)  is  to  note  that  for 
any  strictly  stationary  process  the  inequality 

7 O')  <  70'  +  1 )  T  “ 

always  holds,  and  then  letting  N  — ♦  oo.  (0.28)  follows  because  7 (j)  is  inde¬ 
pendent  of  N . 


A  slightly  more  involved  result  gives  a  condition  under  which  the  fir.t 
order  correlation  P\{c>),  viewed  as  a  function  of  a  €  A  C  R\ 

Pi  :  A  — +  [-1,1] 

is  monotone. 

Corollary  3.  Consider  the  parametric  family  of  filters  {£0(  ),  a  £  A},  and 
assume  that  for  each  o  £  A  , £a(-)  has  a  well  defined  inverse  £"„(•).  Suppose 
that  for  a  <  0,  a,0  £  A, 


G(ui\  a,  0) 


\U(^0)\2 

|//(*;o)l2 
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is  monotone  decreasing  in  u>  €  [0,  ;r].  Then 

Pi  (a)  S  Pi{0) 

If  in  addition  { Zt }  is  Gaussian  then  also 

E[Da]  >  E\D0\ 

The  inequalities  are  reversed  when  G(u>;a,/?)  is  monotone  increasing  in 

oj  e  [o,  7r]. 


Proof:  Operate  on  { Zt(a )}  with  the  squared  gain  of  this  sequential 

filter  is  G(in;a,/?)  which  is  assumed  to  be  monotone  decreasing.  Therefore 
by  Theorem  2  , 

Pi(<*)  <  P\{G) 

where  p\{G)  is  the  first  order  correlation  in  the  filtered  process 

C0C-QCa{Z)t  =  Cp(Z)t  =  Zt{0) 

Therefore  pi(G)  =  pi(fi)  and 


P\{a)  <  Pi(G)  =  pi(0) 

In  the  Gaussian  case  this  entails, 

/  \  t*E[Da)s  ^  *-£(£>0] 

p.fo)  =  cos(~N  __  1  )  <  Pl(0)  =  cos{  _  t J) 
and  since  cos(x)  is  monotone  decreasing  in  [0, 7r]  we  obtain 

A'  -  1  -  A'  -  1 


The  converse  can  be  proved  similarly. 

□ 
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0.4.2  Determining  the  correlation  generating  function 
from  HOC 

In  this  section  we  specialize  to  the  parametric  family 

£a{Z)t  —  Zt  CxZt_ i  +  Qt2Z(_2  +  •  •  • 

The  transfer  function  and  squared  gain  are  given  by,  respectively, 


H(u-a)  = 


1  —  q  exp(—  iu>) 


\H(u>;a)\2  =  - - - - — - - 

1  —  2acos(uj)  -f  a2 


for  u>  €  [0, 7r] ,  or  €  (  —  1,1).  The  corresponding  impulse  response  is  readily 
seen  to  be 

/,  ,Vv\  _  /  Qn>  n=0,l,2,  ••• 

|  0,  otherwise 

Therefore,  from  Lemma  2,  the  impulse  response  of  Ja  (•)  is 


0n(a)  =  - o  ’  n  ~  ’  ±2i  ‘  ’ 

1  —  a1 


and  by  operating  on  p*, 


AW.  =  T— +  T-1^  £lo|n+"  +  o'”'")/’. 

1  —  cr  1  —  a 1  TT, 


Let  <f>{a)  be  the  correlation  generating  function  of  {Z(}, 


It  follows  that, 


4>(a)  =  £  pnan,  |q|  <  1 


Ja{p)o  =  7 - j[2<?Ha)  -  1] 

1  —  Q* 


J*{p)\  = 


a<t>{a )  +  a~'<f>(a)  -  a  1 


and  therefore 


Pi(o) 


(1  +  a2)<j>(a)  -  1 

<*[2 <j>(a)  -  1] 


a|  <  1 


Solving  for  <f>(a)  in  terms  of  pi(a)  we  finally  have, 


(0.30) 


Theorem  3.  The  correlation  generating  function  <j>( a)  of  {Zt},  a  zero-mean 
stationary  process,  is  obtained  from  pi(a)  by  the  equation 


<f>{a) 


1  -  api(or) 

1  —  2ap\[ot)  -f  Q2  ’ 


If  in  addition  {Zt}  is  Gaussian,  then 


(0.31) 


4>{a) 


1  —  £*CO.s(7r7(a)) 

1  —  2qcos{‘k^{q))  -f  a2 


1  —  acos(  7T7(a)) 
|//(7r7(a);o)|2  ’ 


(0.32) 


It  follows  from  (0.32)  that  in  the  Gaussian  case  knowledge  of  the  normalized 
expected  zero-crossing  rate  7 (a)  is  equivalent  to  knowing  the  normalized 
spectral  density 


/» 


m 

fl.fiW  A 


Corollary  4.  Let  {Ztj,  t  —  0,  ±1,  ±2,  •  •  •,  be  a  zero  mean  stationary  Gaussian 
process.  For  |o|  <  1  and  u>  €  [0,7r],  the  following  equivalent  relations  hold: 

7(0)  4=7  <£(q)  <=>  p,( q)  <==>  f(u>) 


7(a)  is  a  new  tool  in  time  series  analysis  motivated  by  the  equivalence 
relations  in  Corollary  4.  The  data  example  in  the  next  section  provides  some 
insight  necessary  for  judging  the  usefulness  of  this  device.  As  examples,  we 
consider  some  special  cases. 


(0.33) 

(0.34) 


Example  1:  Gaussian  white  noise. 

For  |a|  <  1, 

Pi{o)  =  ct 

7(a)  =  — cos-1(a) 

7 r 

and 

4>(a)  =  1  (0.35) 

Given  any  process,  we  find  it  very  helpful  in  applications  to  compare  its 
zero-crossing  rate  j(o)  with  that  of  white  noise  given  in  (0.34).  See  Figures 
3,4. 


Example  2:  First  order  autoregressive  process  . 

Consider  a  stationary  Gaussian  AR(1)  process  with  parameter  a j, 

Zt  =  a.\Zt-\  +  t(,  t  =  0,  dhl,  •  •  • 


where  |ai  |  <  1,  and  {c(}  is  Gaussian  white  noise.  For  |o|  <  1, 


.  a  -f  oj 

'”(a)  -  !+.,« 

(0.30) 

7(a)  -  cos  •(  ) 

IT  1  OiO 

(0.37) 

and 

<t>{a)  = 

1  —  OjO 

(0.3S) 

Figure 

3  gives  the  graphs  of  7(a)  for  a  1  =  —  .6,---,0, 

• ,  0.6.  The  case 

ax  =  0  corresponds  to  white  noise  and  is  given  for  reference. 


Example  3:  Sum  of  sinusoids  plus  white  noise. 
Consider  the  mixed  spectrum  process  (0.11).  For  |o|  <  1, 


ZP  j;  |  aat 

J  =  1  ]  —2 aco»(uij  )  +  oJ  l—o 


yp  _ lx _ ,  + 

‘—'1—  1  1  -2ocos(wj  )+<v  '  1— ce 


=  -COS  1  (/>!  (o)) 
7T 


(0.39) 


7  (o) 


(0.40) 


and 


4(a) 


a](\  -aco$(ur,)) 

1  12Qcom(^)^ 


ZU  +  ®? 


+  *: 


(0.41) 


Figure  4  gives  the  graphs  of  7(a)  in  the  case  of  p  =  1  for  several  values  of  the 
frequency  u>i  when  the  signal  to  noise  ratio  is  20dB  (very  little  noise).  The 
figure  also  gives  the  zero-crossing  rate  of  white  noise  for  comparison.  Near 
the  origin  the  graph  of  7(a)  is  close  to  a  horizontal  line  as  is  expected  in 
light  of  our  next  result. 


As  a  function  of  a  €  (  —  1,1),  7 (a)  is  always  monotone  decreasing,  a  fact 
th^t  makes  it  useful  in  comparing  different  processes.  When  the  process  is  a 
pure  sinusoid,  7(a)  is  a  constant.  In  the  Gaussian  case  the  converse  is  also 
true. 


Theorem  4.  Let  { Zt },  t  =  0,  ±1,  ±2,  •  •  •,  be  a  zero  mean  stationary  Gaussian 
process.  Then 


(a)  7(0)  is  monotone  decreasing  in  q  6  (  —  1,1). 

(b)  7 (a)  is  constant  if  and  only  if  { Z( }  a  pure  sinusoid  with  probability  one. 


Proof:  To  prove  (a)  we  apply  Corollary  3  to 


|//(w;q)|: 


_ 1 _ 

1  —  2 acos(u)  -f  q2 


We  show  that  for— 1<q</3<1 


C(  >•  ty  rn  -  _  1  -  2qcos(u;)  +  q2 

1  ’  'p)  |//(u;;q)|2  1-2  (3cos(u>)  +  (3* 

is  monotone  decreasing.  So,  for  0  <  u>j  <  102  <  7r  the  numerator  of  the 
difference 

G(u;2;q,/?)  -  G(u>i;  a,  /?) 
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is  equal  to 


2(cos(u>i)  —  cos(u;2))(l  —  a/?)(a  —  /?)  <  0 


and  (a)  follows. 


To  prove  (b),  if  {Zt}  is  a  pure  sinusoid  with  frequency  u>t ,  then  from 
(0.39), 

Pi(a)  -  cos(wj)  =  cos(tt7(q)) 

or  for  all  |oj  <  1, 

7(q)  =  — 

7T 

and  7(0)  is  constant  on  (  —  1,1).  Conversely,  if  7(0)  is  constant  for  a!'  a  £ 
(  — 1, 1),  then  there  exists  Wj  £  [0,  tt]  such  that 


/  .  ^ 1 

7(o)  =  — 

7 r 

for  all  o  £  (  —  1, 1).  Thus,  from  (0.32)  we  have, 

.  1  —  acos(7r7(o))  1  —  acos(o?i) 

°  1  —  2acos(ir^(a))  +a2  1  —  2acos(u>i)  +  a 2 

But  this  is  the  correlation  generating  function  of  a  pure  sinusoid.  To  complete 
the  proof,  note  that 


P\  =  *'(0)  =  COs(uq) 


P2  =  -<t>  (0)  =  cos{2ul ) 


Therefore, 


Var[7  ~  %PiZt-i  +  Zt-iY  =  2(1  —  2 p]  +  P2)  =  0 

so  that  with  probability  one  {Zt}  satisfies  the  stochastic  difference  equation 

Zt  —  2piZt_i  +  Z(_  2  =  0 

whose  solution  is  a  sinusoid  with  frequency  u\. 

□ 


27 


Remark  2.  We  can  improve  statement  (b)  in  Theorem  4  by  noting  that  if 
for  some  Oj,  a2  €  (  —  1,1), 

7(qi)  =  7(02),  — 1  <  «i  <  0  <  a2  <  1  (0.42) 

then  by  monotonicity  7(a)  is  constant  in  the  interval  [ai,a2]  that  contains 
the  origin.  Because  <f>(a)  is  analytic  at  a  =  0,  the  same  argument  as  in 
the  above  proof  shows  that  { Zt }  must  then  be  a  sinusoid  under  this  weaker 
condition.  Thus  (b)  can  be  replaced  by  the  stronger  statement  that  { Zt } 
is  a  pure  sinusoid  with  probability  one  if  and  only  if  (0.42)  holds  for  some 
— 1  <  orj  <  0  <  Qj  <  1.  Compare  with  Kedem(1984). 
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Figure  4.  Plots  of  7(0)  from  a  single  sinusoid  plus  white  noise; 
SNR=20dB.  The  plots  correspond  to  frequency  07  =  0.057T,  0.15tt,  ■  •  • ,  0.95 7r . 
The  intersecting  curve  is  the  zero-crossing  rate  of  white  noise. 
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0.5  Jn{0)  as  a  descriptive-diagnostic  tool 

Given  a  parametric  family  of  filters  {£*(■)} ,  there  are  several  ways  to  ap¬ 
ply  the  corresponding  observed  zero-crossing  rate  7/v($).  We  describe  two 
procedures  and  then  apply  them  to  real  data. 

0.5.1  Two  useful  procedures 

(A).  HOC-plots. 

In  this  procedure,  7at(0)  is  plotted  as  a  function  of  6  6  0  as  a  descriptive  de¬ 
vice  that  summarizes  the  data  very  much  like  the  estimated  spectral  density. 

When  Ce{-)  =  then  for  sufficiently  large  Ar,  7/v(0)  is  increasing  as 

a  function  of  6  =  1,2,---.  Experience  shows  that  the  initial  rate  of  increase 
is  a  useful  discriminator. 

When  Ca  =  7 A'(o')  tends  to  decrease  for  a  6  (  —  1,1).  From 

the  Gaussian  case  we  already  know  that  attention  should  be  given  to  7/v(a) 
for  a-values  near  the  origin. 

In  any  application,  it  is  helpful  to  include  also  the  plot  of  7 (9)  from  a 
known  process,  usually  Gaussian  white  noise,  for  reference  as  done  in  Figures 
1,2- 

If  a  certain  hypothesis  is  entertained,  we  can  test  it  by  observing  whether 
the  HOC  plot  from  the  data  falls  within  certain  probability  bands.  The 
probability  limits  can  be  obtained  from  the  asymptotic  normality  of  7 /v(0) 
when  it  holds.  A  surprisingly  good  approximation  to  the  variance  of  7 n(6) 
under  the  Gaussian  assumption  is  given  for  each  fixed  6  by  the  formula 
(Kedem(1987)): 

1/Qr[7jv(0)]  ^  (0.43) 

7(0)0  -7(A))  _  V(9)  i2t(0)(1  —  7(0))(1/(0)  ~  7'(0)) 

IV  -1  1  Ar  —  I  (1  -  i/(0))(A'  ~  1) 

where 
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(0.44) 


f1_7(0)lfl  Ae)~^e)\N-u 

1  (0) -  [rr^)1[1 ~ ("  i -to)  ]  1 


u(e)  = 


1-2A,(0)  +  A2(0) 
2(1  -  A, (0)) 


and 


A»(0)  =  i  +  -sin  lpn{0),  n  =  1,2,  ••  • 

Z  7T 

Observe  that  ~f(6)  =  1  —  Ai(0).  In  this  connection  we  have. 


(0.45) 


(0.46) 


Theorem  5.  Assume  that  {Ztj  is  Gaussian  white  noise  and  consider  ')n(o) 
from  the  o-filter.  Then  for  each  fixed  o  €  (  —  1,1)  as  N  — *  oo, 


7 n(q)  ~  7(a) 
]/Var[w(a)] 


^(0,1) 


Proof:  Follows  easily  by  noting  that  { Zt }  is  Gaussian,  Da  is  a  sum  of  indi¬ 
cators,  and  that  pn(a)  =  a'n',  n  =  0,  ±1,  •  •  •. 

□ 


Thus,  under  the  hypothesis  of  Gaussian  white  noise,  for  each  fixed  a  £  (  —  1,1) 
we  can  find  an  approximate  probability  interval  that  contains  7at(q)  using 
(0.43). 

(B).  Deviation  from  white  noise. 

Measuring  the  deviation  of  the  observed  HOC  from  the  expected  HOC  of 
Gaussian  white  noise,  is  a  recommended  procedure.  A  successful  application 
of  this  idea  has  been  reported  in  Dickstein  et  al.(1989)  in  discriminating  be¬ 
tween  ultrasound  echo  signatures  obtained  from  bonded  aluminum  specimens 
that  underwent  different  surface  treatment  prior  to  bonding.  To  measure  de¬ 
viation  from  white  noise,  Dickstein  et  al.  used  the  xp7  statistic  discussed  in 
Kedem  and  Slud(1982),  but  using  observed  rather  than  expected  HOC  from 
white  noise. 

Another  variation,  is  to  construct  HOC-grams  from 

1n{0)  -  7w(0),  0  €  0  (0-47) 
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where  7 w(0)  is  the  expected  zero-crossing  rate  of  Gaussian  white  noise.  By 
applying  (0.47)  to  different  stretches  of  the  data  each  of  length  N,  we  obtainc 
an  image  in  two-dimensional  time  x  0  space  called  HOC-gram.  When  the 
o-filter  is  used,  the  HOC-grams  are  obtained  from 

7yv(or)  -  -cos-1(o),  o  €  (-1,1)  (0.48) 

7T 

Many  other  variations  are  possible. 

0.5.2  Tracking  the  vocal  sound  of  a  humpback  whale 

The  vocal  sound  of  cetaceans  is  a  subject  of  interest  to  marine  biologists 
who  consider  the  sound  of  these  animals  as  a  feature  of  their  adaptation  to 
aquatic  existence  (Schevill  and  Watkins  (1962).)  Tracking  and  identification 
of  distinctive  whistle  patterns  of  whales  and  porpoises  is  thus  an  important 
element  of  the  research  on  cetaceans.  The  actual  business  of  recording  sound 
at  sea  presents  some  difficulties  because  of  ambient  sea  noise  due  in  part  to 
machinary  on  board  ships  and  to  the  movement  of  waves  against  bodies  such 
as  ship  hulls.  In  what  follows  we  apply  HOC  analysis  to  a  vocal  sound  series 
uttered  by  a  humpback  whale  in  ambient  sea  noise.  The  series  was  recorded 
45  miles  east  of  Boston.  More  information  about  the  series  and  the  recording 
device  can  be  found  in  Schevill  and  Watkins  (1962). 

The  series  consists  of  3  seconds  worth  of  data  sampled  at  the  rate  of 
20  KHz,  and  recorded  with  12  bit  resolution  in  the  form  of  integers  in  the 
range  0  —  4095.  Because  we  are  interested  in  tracking  as  well  as  identifica¬ 
tion,  the  data  were  partitioned  into  stretches  of  0.1  second  containing  2048 
observations  each. 

Figure  5  was  obtained  from  the  stretch  of  data  ending  at  0.2  seconds.  The 
figure  shows  plots  of  the  observed  zero-crossing  rate  7/v(0)  from  simple  HOC 
and  HOC  from  the  o-  filter.  As  explained  above,  the  figure  contains  also 
95%  probability  limits  and  7 (0)  from  Gaussian  white  noise  for  reference  and 
for  measuring  the  similarity  to  white  noise.  Observe  that  -f(0)  is  between  the 
probability  limits  by  construction.  The  hypothesis  of  white  noise  is  obviously 
rejected,  as  is  well  expected,  by  both  types  of  HOC,  but  the  HOC  from  the 
o-filter  are  more  informative  because  they  point  to  the  possibility  that  the 
data  may  follow  a  low-order  AR  process.  This  is  seen  by  comparison  with 
Figure  3.  It  is  interesting  to  note  that  the  simple  observed  HOC  behave  very 
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much  like  the  expected  simple  HOC  from  white  noise  for  higher  differences, 
while  the  observed  HOC  from  the  o-filter  exhibit  a  similar  phenomenon  for 
values  of  a,  roughly,  greater  than  0.4.  That  is  to  say,  in  this  sense  some  parts 
of  HOC-plots  are  more  informative  than  others. 

Figure  6  portrays  the  same  analysis  applied  to  the  stretch  of  data  ending 
with  0.5  seconds.  The  data  now  show  greater  similarity  to  white  noise  as 
seen  from  both  HOC  plots  (a),(b),  but  the  hypothesis  of  white  noise  is  still 
rejected.  We  conclude  that  the  signal  is  less  powerful  than  the  previous  one. 

Figure  7  shows  a  marked  deviation  from  white  noise  and  the  presence  of 
a  powerful  signal  in  the  stretch  of  data  ending  at  1.4  seconds.  The  signal 
is  not  sinusoidal  because  with  that  much  power  we  would  expect  from  the 
simple  HOC  that  7jv(1)  ss  7^(2).  But  since  this  obviously  is  not  the  case, 
a  sinusoidal  component  is  ruled  out.  However,  by  comparing  the  HOC-plot 
corresponding  to  the  o-filter  with  the  HOC-plots  in  Figure  3  we  sec  that  a 
low-order  AR  sound  component  is  a  very  reasonable  model  for  this  stretch 
of  data.  This  example  shows  that  the  HOC  plots  from  the  a-filtcr  and  from 
repeated  differencing  complement  each  other.  Both  are  useful  in  applications. 

Next  we  obtain  the  HOC-grams  (0.48) 

7/v(o)  -  --cos-1  (o),  a  €  (-1, 1) 

7T 

for  19  a-values,  a  =  — 0.9,  — 0.8,  -  -  -  ,0,0.1,  ••  -  ,0.9,  and  for  non-overlaping 
stretches  of  data  each  corresponding  to  0.1  seconds.  The  o- values  are  on  the 
ordinate  while  the  abscissa  is  the  time  axis.  The  values  of  the  HOC-gram  are 
given  in  the  form  of  grey  levels.  Darker  levels  correspond  to  more  negative 
values  of  7 /v(a)  —  £ cos~i(a ),  while  lighter  levels  correspond  to  more  positive 
values.  We  can  see  from  the  HOC-gram  given  in  Figure  8  that  the  entire 
data  set  contains  three  distinct  pronounced  utterances.  From  Schevill  and 
Watkins  (1962)  we  know  that  this  is  what  was  in  fact  expected. 

It  is  interesting  to  see  what  a  spectral-gram  from  the  same  stretches  of 
data  gives.  Figure  9  gives  the  logspectral-  gram  obtained  from  AR-spectral 
estimates  by  fitting  to  each  subseries  of  0.1  seconds  an  AR(20)  model.  It  is 
possible  to  see  correspondence  between  the  HOC-gram  and  the  logspectral- 
gram,  but  the  HOC-gram  gives  a  much  clearer  tracking  of  the  vocal  sound 
series. 
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Figure  6.  Plots  of  7n(0)  and  95%  probability  limits  for  the  stretch 
of  whale  data  ending  at  U.5  seconds,  (a)  Simple  HOC.  (b)  HOC 
from  the  o-filter. 


'I 


RHOCDIF  OF  62033-21  AT  0 . 5  SEC  with  95t  T-BOUNDS  FOP  GWN 
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Figure  8.  HOC-gram  from  a  vocal  sound  of  a  humpback  whale. 
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Captions  of  Figures  and  Tables 
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Figure  1.  Realizations  from  processes  with  adjoined  random  vari¬ 
ables  with  p=0.1,  0.25,  0.5,  0.75. 

Figure  2.  Plots  of  normalized  HOC.  (a)  Simple  HOC.  (b)  HOC 
from  the  a-filter. 

Figure  3.  Graphs  of  7(a)  from  AR(1)  with  parameter  a.i  = 

—0.6,  —0.5,  ■  •  •  ,0,0.1,-  •  •  ,0.6.  dj  =  0  corresponds  to  white  noise. 

Figure  4.  Plots  of  7(0)  from  a  single  sinusoid  plus  white  noise; 
SNR=20dB.  The  plots  correspond  to  frequency  =  0.057r,  0.157T,  •  •  • ,  0.95r. 
The  intersecting  curve  is  the  zero-crossing  rate  of  white  noise. 


Figure  5.  Plots  of  7 N(0)  and  95%  probability  limits  for  the  stretch 
of  whale  data  ending  at  0.2  seconds,  (a)  Simple  HOC.  (b)  HOC 
from  the  a-filter. 


Figure  6.  Plots  of  7 ^(6)  and  95%  probability  limits  for  the  stretch 
of  whale  data  ending  at  0.5  seconds,  (a)  Simple  HOC.  (b)  HOC 
from  the  a-filter. 


Figure  7.  Plots  of  7 ^(0)  and  95%  probability  limits  for  the  stretch 
of  whale  data  ending  at  1.4  seconds,  (a)  Simple  HOC.  (b)  HOC 
from  the  a-filter. 

Figure  8.  HOC-gram  from  a  vocal  sound  of  a  humpback  whale. 


Figure  9.  logspectral-gram  from  a  vocal  sound  of  a  humpback 
whale. 
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Table  1.  Convergence  of  towards  u>j  =  0.8  with  N 
where  the  signal  to  noise  ratio  (SNR)  is  given  in  dB. 


=  10000 


43 


